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STATEMENT REGARDING FEDERALLY SPONSORED 
RESEARCH OR DEVELOPMENT 

The present invention was supported in part by grant number ROl CA72023 from the 
National Institutes of Health (NIH/NCI). The U.S. Government has certain rights in the 
5 invention. 

FIELD OF THE INVENTION 

The present invention relates generally to medical imaging. More particularly, the present 
invention relates to methods for matching and registering medical imaging data based on 
10 anatomical similarity. 

BACKGROUND 

Computed Tomographic Colonography (CTC) is a minimally invasive method for the 
examination of the colon using spiral/helical CT volume data. The standard imaging 

15 process includes colon cleansing and air-insufflation, followed by CT imaging of the 
abdomen while the patient is in the supine position. However, insufficient cleansing and 
air-insufflation often cause some parts of the colon wall to be covered with water (See e.g. 
S.C. Chen et al., "CT colonography: value of scanning in both the supine and prone 
positions," Am J Roentgenol vol. 172(3), pp. 595-599, 1999; J.G. Fletcher, et al., 

20 "Optimization of CT colonography technique: prospective trial in 180 patients," Radiology, 
vol. 216(3), pp. 704-711, 2000; J. Yee, et al., "The usefulness of glucagon hydrochloride 
for colonic distention in CT colonography" Am J Roentgenol vol. 173(1), pp. 169-172, 
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1999). Furthermore, retained solid fecal material can mimic a polyp in CT images (See e.g. 
J.G. Fletcher et al. "CT colonography: potential pitfalls and problem-solving techniques," 
Am J Roentgenol vol. 172(5), pp. 1271-1278, 1999 (With comments in Am J Roentgenol, 
vol. 172(5), pp. 1179, 1999)). These limitations are largely overcome by imaging the colon 

5 a second time with the patient in the prone position. The radiologists then compare the two 
sets of images to assess for movement of feces and to examine surfaces hidden in supine 
position. This requires careful anatomic alignment between the two data sets. However, as 
the patients change position, their colons deform and may stretch or shrink in length. 
Currently, anatomic . matching the two data sets is tedious and time consuming. 

10 Accordingly, there is a need for a more convenient and automatic method that would allow 
matching of these two data sets. 

SUMMARY OF THE INVENTION 

The present invention provides an automatic method for the registration of prone and 
15 supine Computed Tomographic Colonography (CTC) data. The method improves the 
radiologist's overall interpretation efficiency as well as provides a basis for combining 
supine/prone computer-aided detection results automatically. In general, the method 
matches and registers medical image data obtained from different perspectives or taken at 
different times. The medical image data could be obtained from other organs or (tubular) 
20 structures other than the colon such as blood vessels or airways, other areas of the 
gastrointestinal tract, and solid structures or organs that can be segmented, such as bones. 



Once the medical images are obtained, e.g. supine or prone data of the colon, the method 
determines centralized paths or axes of the colon. The method then determines relatively 
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stationary points, referred to as landmarks, along the centralized axis/path of the colon for 
both supine and prone positions. In one aspect, these landmarks are local extrema (minima 
and maxima along the path). These landmarks typically relate to known and automatically 
identifiable anatomical points or flexures of the colon and are used to match the data sets. 

5 Stretching and/or shrinking of either the supine or prone centralized path perform the 
registration of these landmarks. The stretching and/or shrinking could be performed in a 
linear or a non-linear fashion. The stretching and/or shrinking could be performed using 
one or more local extrema, n-th order derivations, curvatures, or the like. The method 
could be performed on either one of the x, y, z axis or any combination or order of these 

10 axes. The matching occurs in an iterative and recursive manner and is considered 
successful based on one or more decision criteria. 

BRIEF DESCRIPTION OF THE FIGURES 

The objectives and advantages of the present invention will be understood by reading the 
1 5 following detailed description in conjunction with the drawings, in which: 

FIG. 1 shows an example of a 3D view of prone (a) and supine (b) colon images from 
one patient, which were segmented using fixed threshold intensity, according to 
the present invention; 

FIG. 2 shows an example in which arrows 210, 220, 230 and 240 show possible 
20 landmark locations and a centralized path 250 that the method of the present 

invention is capable of locating automatically; 
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FIG. 3 shows an example of a colon centerline path, both supine (solid line) and prone 
(dashed line), as three functions of x, y and z coordinates versus path length 
originated from the anus; 

FIG. 4 shows an example of supine data (410 z s ) and prone data (420 z p ) before the 
5 registration and the supine data (415, dashed line) after it was matched/registered 

onto the prone data. The bold points on the curves show the local extrema 
(landmarks) that were identified and used for matching automatically; and 

FIG. 5 shows an example of the colon centerlines for a supine (510) and prone (520) data 
with five anatomically identical points marked on each by a radiologist. The 
10 mapping between the two centerlines before (530) and after (540) the matching, in 

terms of the equal distance to the rectum along the centerlines, is also shown. It is 
clear that the matching method of the present invention achieves close 
correspondence between anatomically identical points (the correspondence 
between the 4 th anatomically identical points is shown). 

15 

DETAILED DESCRIPTION OF THE INVENTION 

Although the following detailed description contains many specifics for the purposes of 
illustration, anyone of ordinary skill in the art will readily appreciate that many variations 
and alterations to the following exemplary details are within the scope of the invention. 
20 Accordingly, the following preferred embodiment of the invention is set forth without any 
loss of generality to, and without imposing limitations upon, the claimed invention. 
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. Colon wall segmentations for both the 3-dimensional (3D) prone and supine CT data were 
generated using seeded region-growing at a fixed intensity threshold (FIG- 1). From the 
segmented colon, centralized paths through the colon were computed using a 3D medial 
axis transform, for instance sampled at 1mm intervals, and stored as x, y, and z coordinates 

5 (See e.g. D.S. Paik et al. 1998, "Automated flight path planning for virtual endoscopy", 
Medical Physics 25 (5), 629-637) (FIG. 2). The centralized paths could also be computed 
with another method known in the art. Instead of using a centralized path, one could also 
use a path that can be obtained in a fairly consistent manner from the data sets. It would be 
preferred that the resulting (centralized) path is a fairly smooth path. In case the computed 

10 (centralized) path still contains a certain amount of noise, this noise could be filtered out 
with any type of digital filter known in the art. 

The x, y, and z coordinates of the centralized path were used as the inputs to the matching 
and registration method. As a convention, the +z axis is from feet to head, the +x axis is 
15 from the left side of the patient to the right side, and the +y axis from posterior to anterior 
(See FIG, 2). Distances along the centralized path and the coordinates could be defined as 
relative to the initial path point at the anus 260. 

The path coordinates of supine data (x,, y s , z 5 ) and prone (x p , y p , z p ) are functions of the 
20 distance along the centralized path, d. FIG. 3 shows an example of these six functions for a 
single patient. An important observation at this point is that x s , y s , z s resemble x p , y p , z p 
respectively in terms of their morphologies, but not at the location along the centralized 
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path d. It is therefore the objective of the present invention to compare and match the data 
according to landmarks such as their anatomical feature and location on the respective 
centralized paths. Once correspondence between the landmarks is matched, linear and/or 
non-linear operations can be applied so that the matched landmarks coincide along the path. 
5 The description infra focuses on the z axis for the sake of simplicity, though the method can 
be similarly applied to any individual (or combination of) axis (axes). 

The morphological similarity between z s and z p can be observed as a similarity between the 
number of landmarks, such as local extrema used in this particular example (LoP; including 

10 local minima or local maxima), and their order in terms of their z values as shown in FIG. 
4 If one sorts the LoP's with respect to their z values, the LoP's of z s and z p with equal or 
close indices are more likely to correspond to the same anatomical points along the central 
paths. In anatomical terms, LoP's correspond to the deflection points of the central path of 
the colon and are used as landmarks for the method. It is noted that the method is not 

15 limited to the use of local extrema since other landmarks could, be used such as n-th order 
derivations, curvatures, or the like. 

Despite of the fact that these deflection points may move within the 3D volume (patient's 
abdomen) between supine and prone scans, they remain to be deflection points with (small) 
20 shifts in their locations to d. Furthermore, LoP's with larger z coordinate values typically 
correspond to relatively more stable anatomic points. They also correspond to the points 
further away from the anus 260, for example, LoP's with highest z values are the most 
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superior locations in the colon. Anatomically these points typically correspond to the 
hepatic 210 and splenic 220 flexures (FIG. 2). These relatively fixed flexures are the 
endpoints of the much more mobile transverse colon. It is noted that LoP's along the other 
axes correspond with different anatomical points. In general, we have observed that 
5 between prone and supine scans the colon generally deviates less in z- than the y- or x-axis, 
and the colon is more likely to deform in y-axis than other two axes (i.e. misalignment 
between supine and prone data set). 

The path matching method is based on coupling LoP's for the x-, y-, and z- axes. In a 
10 specific example, the path registration method is based on coupling of LoP's of z s and z p 
and registering their positions with respect to d by segmental stretching and/or shrinking of 
one of the two paths. The method is not limited to using the supine or prone data set as a 
reference to match the prone or supine data set respectively. 

15 The first step is baseline adjustment of the two paths. It is assumed that the beginning and 
the ending point of the two paths (spPt and prPt) correspond to the same anatomical points, 
the anus and the tip of the cecum. Let the path length functions of the spPt and prPt be 
D s (i) = i,ie [l,N s ] and D p {i) = i,ie [1,N p ] respectively. A linear transformation, T, is 

applied such that: 

20 D p (X) = D s (l) = T(D s (X)) (1) 

D p (N p ) = D s (N s ) = T(D s (N s )) (2) 
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This is equivalent to taking the first and last point of the two paths as two pairs of coupled 
LoP's of spPt and prPt and registering them with respect to d. The z values along the spPt 
are also changed linearly such that z s (1) = z p (1) and z s (N s ) = z p (N p ). Note that the linear 
transformation, T, is the mapping between spPt and prPt. It will be modified in the 
5 subsequent steps in a nonlinear fashion to yield to final piecewise linear mapping function. 

A 

The second step is to determine the LoP's. The landmarks (local extrema) of z s (D s ) and 
z p (D p ) are determined using numerical derivation and neighboring extrema are clustered 
such that the minimum distance along the path between two consecutive clusters is for 
10 instance 15 mm. The mean location along the path and the mean z value for spPt and prPt 
(LoP_s's, i.e. LoP's on the supine data, and LoP_p's, i.e. LoP's on the prone data, 
respectively) are used. These identified LoP_s's and LoP_p's are ordered with respect to 
their z values and indexed. FIG. 4 shows the LoP_s's and LoP_p's for z s and z p . 

15 The next step is to find the LoP_s, LoP_p pair most likely to correspond to the same 
anatomical point. The decision criteria are based on the differences between their z values 
and their locations along the path. 

jje {1,2} and ' (3) 



D s {LoP _ s(i)) - D p (LoP _ p(j)) 



< 100mm (4) 



K<D s ,D p <L (5) 
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where i and j are indices assigned to LoP's in the region of interest (ROI, defined by (5)) 
only with respect to their z values. Condition (3) forces the algorithm to match LoP's 
starting from the ones furthest away from the anus, i.e., the ones most likely to correspond 
to anatomical landmarks (like the hepatic and splenic flexures). Condition (4) is a 
constraint in the maximum stretching/shrinking allowed. In this example this maximum is 
set to 100 mm, however the maximum allowed stretching/shrinking could also be smaller 
or larger than 100 mm. Condition (5) defines the boundaries of ROI on which the 

registration is applied. Initially, K=D p (N p ) = D(N S ) and L =D p (1) = D(l) . Then a linear 

A 

stretching/shrinking operation is applied to D s such that: 

T(D s (LoP _ 5(0) = D p (LoP _ p(j)) (6) 

The method matches the right and left hand sides of the matched point recursively, for a 
pre-speficied level of recursions or until it could not find any pair of LoP's that satisfy the 
above criteria. The recursive matching and registration algorithm could be summarized as 
follows: 

1 . Perform baseline correction 

2. Find LoP's 

3. Initialize recursion Jevel = 0 and K and L to set ROI 

4. Sort and index LoP's in ROI 

5. If recursion Jevel < max_recursion Jevel AND a pair of LoP's and LoP'p are 
matched based on equations (3), (4), (5) 
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a. Update D s , based on equation (6) 

b. Increase recursion_level by 1 * 

c. Ko = K ? Lo = L 

d. Set K = D s (LoP _ s(i)) = D p (LoP _ p(j)) 
5 e. Go to step (4) (process right hand side) 

f. Set K = K 0 ,L = D s (LoP _ s(i)) = D p (LoP _ p(j)) 

g. Go to step (4) (process left hand side) 

6. Output D s 

10 The method described supra for the z axis can be similarly applied to x and y axes exactly 
in the same way. The order in which the axes are considered can be iterated until it 

converges to a final l\or for a pre-specified number of iterations. It will be clear that the 
number of axes can be selected as well as the order or the selected axes. 

15 The present invention has now been described in accordance with several exemplary 
embodiments, which are intended to be illustrative in all aspects, rather than restrictive. 
Thus, the present invention is capable of many variations in detailed implementation, which 
may be derived from the description contained herein by a person of ordinary skill in the 
art. For example, the method is also applicable to path comparison and matching of other 

20 tubular structures such as blood vessels or airways, other areas of the gastrointestinal tract, 
and to solid structures that can be segmented such as bones. In addition, the method can be 
applied to other types of imaging data such as magnetic resonance imaging and ultrasound. 
Other possible variations to the current method and implementation relate to the fiducial 
point determination and pair-wise matching which could use the curvature and position 

25 information. The method could further be extended and refined by inclusion of several 
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other types of information, such as torsion, estimated anatomical location, or the like. 
Another variation is that the piece-wise linear operations performed for matching can be 
refined by using non-linear operations. For example, the segments corresponding to the 
transverse colon can be registered by linear operations whereas nonlinear mappings can be 
used for the segments corresponding to the rectum. In one example, coupling is achieved 
by copying the most current mapping to other axes and matches/registers a segment at a 
time while keeping the other segments fixed. The iterative and recursive nature of the 
method can be extended by further including the information from axes and segments other 
than the one being registered, at the time of registration. All such variations are considered 
to be within the scope and spirit of the present invention as defined by the following claims 
and their legal equivalents. 
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